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Abstract. This note examines linear combinations of multi-indexed sequences 
and derives the multivariate generating function of such a linear combination 
in terms of the original sequence's m.g.f. Applications include finding distribu- 
tions and moments of non-negative discrete random variables conditioned on 
non-negative linear combinations of the original variables. Examples include 
independent Poisson r.v.'s and a d-variate multinomial distribution. 



1. Introduction 

Set N = Z>o- Let b : N d — s- C denote a multi- indexed sequence of complex 
numbers. Then the multivariate generating function for b is given by: 

G b {t 1 ,...,t d ) = ^ b Uu-,jd) t l 1 
(ji,...jd)eN<i 

Such generating functions have applications throughout discrete mathematics, espe- 
cially to combinatorial classes and probability distributions FS09 , and prove useful 
in finding recurrences, moments, and asymptotics [Wil94| PW08]. Multivariate gen- 
erating functions can be used to obtain conditional distributions [Xek871 [JKB96 . 
Applications to biochemistry include stochastic models of chemical network theory, 
in particular chemical kinetics [SZ10 . 



2. Main Result 

Fix some matrix A = (ay) € Mat mX( j(N). Define a new multi-indexed sequence 
c : N m — > C by taking linear combinations of the sequence b using the coefficients 
of the matrix A. That is, for (fci, . . . , k m ) 6 N m set: 

C(fci,...,fe m ) = ^2 b (ji,-,3d) 

C7'i.-.j'd)eN d 

(ki,...,k m ) T =A(J lt ...,j d ) T 

Theorem 1. The analogously-defined multivariate generating function for the se- 
quence c is given by: 

g c (zi, . . . , z m ) — G b (n™ 1 zi' 1 , . . . , n™ izf' d ) 

where A = (oy). 
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Proof. This proof mirrors Sontag and Zeilberger's proof of the special case where 
^(jivij'd) * s ^ ne j° m t probability distribution for independent Poisson random vari- 
ables jSZlOj . From the definition: 



G c (zi, . . . ,z m ) = ^2 Hku-M^i 1 " ' 
(fei,...,fc m )eN m 



E E hh,..j*)) z i--- zk n? 

(fci,...,fc m )GN m V (ji,...Jd)eN d / 

{k u ...,k m ) T =A(h,...,j i ) T 



Exchaning the order of summation then yields: 



G c (zi,...,z m ) = ^ ( 



(ji,--;jd)€N d \ (fc 1 ,...,fc m )6N m 

(k 1 ,...,k m ) T =A(j 1 ,...,j d ) T 



— \ " u, , 7 «uiH l-Oidji . . . yOmij'iH Va md j d 

= E • • • C ml ) jl • • • (^ ld • • • 

(ii,...,3 ( j)eN< i 

— r 1 . ( ? ai1 . . . ■y a m\ aid . . . y a m d\ _ fi /-prm Oji -prm a id \ 

— ^b\ z l z m i ' ' ' i 1 z m ^ — t - r til 11 i = l z i i • ■ • > iJ -i=l2j j 



□ 



3. Probability Generating Functions 

Let Xi , . . . , Xd be non- negative discrete random variables (not necessarily in- 
dependent). The multivariate probability generating function (henceforth denoted 
p.g.f.) of Xi, . . . ,Xd is then given by: 

G x (*i,...,td)= E nx 1 =j 1 ,...,x d =j d )t{ i ---t j d « 

Ui,...,j d )en d 

Define new random variables Yi, . . . , Y m by taking linear combinations of the Xf. 

G)"(D 

Proposition 1. The analogously-defined multivariate p.g.f. for Y\, . . . , is given 
by: 

Gy{z\, . ■ ■ ,z m ) = ^ f(Y 1 = k 1 ,...,Y m ^k m )z'[ 1 ---z^ n 

(fci,...,fe m )GN m 

Apply the theorem to the multi-indexed sequences ^>(j 1 ,...,j d ) = ^{X\ — j\, . . . , X d 
jd) and C( fcl: ... ifcm) = P(Yi = ki,...,Y m = k m ). 
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Independence. When in addition X%, . . . , Xd are independent non- negative dis- 
crete random variables, the p.g.f. takes the form: 

d d 

G x (i x , . . . , i d ) = n (e = 3r) 4 r ) = n g ^ w 

r— 1 J r £^ r — 1 

where Gx r is the single- variable probability generating function for X r . It follows 
that the p.g.f. for the linear combinations Y\, . . . , y m is given by: 

d 

G Y (z 1 ,...,z m ) = i[(G Xr (nr =1 zr)) 

r=l 

Example. When X 1} . . . , X^ are independent Poisson random variables (c/. [SZ10] ). 
X r ~ Poisson(X r ), I < r < n: 

Grr(zi, . . .,z m ) 
Simply note that, for 1 < r < n 

G Xr (U) = E = e- A " E = ex P( A ^ - ^ 

i>0 ' i>0 




The Conditional Distribution of X | Y 

Proposition 2. Let the random vectors X, Y be given as in (*). TTien i/ie jomf 
multivariate p.g.f. for X, Y is given: 

Gx,y(*1; • • • )*dj ^1) • • • ) z m) 

E p(x=j,Y = k)^.--^-^-.-4™ 

(j 1 ,...j d ;fe 1 ,...,fc m )GN d + m 
(*l,...,W T =A(j I ,...j'i) T 

= G x (ti-n™ 1 zrV--,^-n™ 1 zf d ) 

This follows from noting that P(X = j, Y = k) = P(X = j) and then applying 
the theorem with b(j u ...j d \ = P(X = j) tf 1 --- t J d d . From joint multivariate p.g.f., it 
is possible to obtain the conditional p.g.f. of X given Y\ = ki , . . . , Y m = k m |Xek87j . 
Further, the conditional pure (resp. mixed) factorial momements correspond to tak- 
ing the coefficient of z^ 1 ■ ■ ■ z%™ in Gx,y (which will be a polynomial in t\, . . . , td), 
taking pure (resp. mixed) partial derivatives with respect to the t r , evaluating at 
ti = ■ ■ ■ = t d = 1, and dividing by P(Y = k). Let [zf • • • zf]G{zi, . . . , z d ) de- 
note the process of extracting the coefficient of z^ 1 ■ ■ ■ z 3 d d in the formal power series 
G(zi,...,Zd) = J2(j 1 ....,j d )eN d G {h,-Jd) z i ' ' ' z d d - Witn tms notation, it follows 
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that: 



E(X[ S1} ■ ■ ■ X { d Sd) \ Y l = k 1 ,...,Y m = k m ) 



x d \ 



(Xx-sty. (x d - Sd y. 



Y\ k\ ; . . . , Y m k m 



E 

(k 1 ,...,k m ) T =A( J1 ,...,j d ) 2 



Jl ! 



*{Xi = ji,...,X d = j d | Y) 



(ii-si)! (j'd-Srf)! 
k fel ' ' • 4r] (jgr • • • grG x , Y (l, z m ) 



[jsf 1 ■■■zt z ]G Y (zi,...,z m ) 
Combining this with Propositions [T] and [2] gives: 

Theorem 2. TTie conditional factorial moments o/X given that Y\ = k\, . . . , 3^, 
avei 

E(x[ Sl) ■■■X ( d Sd) | Y) 



^G x (*i-n£ l2 fv..,t d .n^ 1 ^) 



ltl=-=t<i=l 



[^•••^]Gx(n^ lZl °«>---.n^r) 



Example. If again Xi , . . . , are independent Poisson random variables ( cf. |SZ10| ) , 

X r ~ Poisson(\ r ), 1 < r < n, then: 



n Un 

\r=l \ i=l 



i=l / 

(d m 
A r (t r ■ Y[ z° <r ~ 1 
r=\ i=l 



So that: 



Iz-t ■ • • 



QS! Qs d 



dtl 1 df ti 



l*i=---=td=i 



n^-^-^i n 



-exp^ 

= 1 r=l i=l 



>(EMn- 



A r ' • [2j ■■■Z m ]G Y (Zl,...,Z TO ) 



Thus: 
E(X[ S1) ■ ■ ■ X ( d Sd) | Y) 

d 



]Gy(zi,...,z m ) 



r=l 



[zf 1 ■■■zfa>]G Y (z 1 ,...,z m ) 
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whenever ki — X)r=i a irS r > for all i and otherwise. For computations on ex- 
plicit matrices A, Sontag and Zeilberger developed a Maple package utilizing Wilf- 
Zeilberger Theory to obtain moments and recurrences on the distribution |SZ10j . 

Example. When X\, . . . , X d have a d-variate multinomial distribution [JKB961 pp. 
31-92] for some N € N and < pi, . . . ,p d < 1 where X)i=i P« = 1> tnc multivariate 
generating function is given: 



(ii,...Jd)6N d 
JiH hj' d =JV 



.31, ■ ■ ■ , 3d 



= {pih + ■ ■ ■ + p d t d ) N 

It follows that: 

• • • ^G x ( tl • n™ lZ r, . ..,t d - uZi^ d ) 

----- — (Pimz + • • • + Pd^n^!^")^ 



Whence: 

(t) [4 1 ■ ■ ■ 4r] (gr • • • fjrGx(;i • n-^f", . . . , id . n™ «)) | ti= ... =td=1 
- ^feSr ' ^ •••^•]{(n£i«F- l84r * r ) (E^n-x,-)^— } 

1 r=l 

d 

— (AT-X; d _ s r )! 1 1 ' m J\\Z^ Pr i=1 « / J 

r_1 r r=l 

The multinomial theorem permits the re-writing of the bracketed expression in ( j) 
above: 

(t) &n™,^f-^ s ' 

r=l 

V 7l * • • • wdl / V 



Oi,...,id)eN d 

Jl+-+i*=JV-Er=l «r 



So that the coefficient of z\ x E " =1 airSr • • • z„ m E;!=1 ^'^ in (}) is: 



(ii,...Jd)SN d 
(fci,...,fc m ) T =AOi+si,...,i d + Sti ) T 

Dividing the above by [z^ 1 • • • zj^ l ]Gy(zi, . . . , z m ) and multiplying by N ' ^ r=1 Pr 
will then yield the desired conditional mixed moment. 



(W-EEiO' 
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